DOCOMENT EESDBE 



ED 142 637 OD 017 140 

aOTHOR Siegelman^ Marvin 

TITLE Harlem Education Tutoring Program; Community District 

Umbrella Programs^ 1975-1976. 
INSTITOTION New York City Board of Education^ Brooklyn^ N.Y. 

Office of Educational Evaluation. 
POB DATE 76 

NOTE 14p. ; New York City Board of Education Function No. ... 

20-6340 2 ; Best copy avail-able 

EDRS PRICE MF-$0.83 HC-$1.67 Plus Postage, 

DESCRIPTORS *After School Tutoring; Basic Skills; Community 

Agencies (Public) ; *Home Instruction; Parent 
Participation ; *Program Evaluation ; Referral ; 
♦Remedial Mathematics; *Remedial Reading 

IDENTIFIERS New York (Harlem) ; Umbrella Projects 



ABSTRACT 

This report evaluated the Harlem Tutoring Program 
which was designed to give individual home tutoring in reading and 
mathematics to elementary school students in New York City. The 
students were at least two years below grade level in reading and/or 
mathematics. Forty-three students between the ages of six and 
thirteen participated in the program. The* tutors were mostly college 
students who met with the students two days per week, for two hours 
each session. The program attempted to increase the student's 
reading, mathematics, and self-esteem. In addition, parents of 
students were assisted with family, housing, employment, and health 
problems through referrals to agencies. The major emphasis of the 
program was improvement of basic reading skills, including 
comprehension and vocabulary. Audio visual aids were used to provide 
remedial instruction. Pre and post achievement tests, observations, 
interviews, and conferences were used to evaluate the program. The 
findings of the report indicated the range of reading grade scores 
,^^for the total sample was 2.76 to 6.92 months. Accordingly, the range 
in mathematics grade scores was -.09 to 1.89. (JP), 
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CHAPTER I: THE PROGRAM 

The Hsrlem Educ8t:ion Tutoring Program was dasigned to give 
individual tutoring in reading and mathematica to 43 pupila bittwaan 
tha ages of 6-13 years in their own homes after school. Most 
pupils arc at least two years below grade level in reading and/or 
mathematics. Tha pupils live in tha Central Harlem area in 
District 5. Tha tutor maetr wi^h each pupil in the pupil's home 
two days a weak, for two hours 33Cv*. session. The tutors try to 
incr ease the individual child's reading and math levels fvhile 
mmking them feel they can achieve in school by increasing their aansa 
of competence and self-esteem. The program also assists the parents 
of the tutorial students , or acts as a source of referral, for 
problems related to housing, welfare, employment, health, child 
cars, job training, etc. The program is located in a atorefront, 
find although most tutoring takes place in tha home of the child, 
some small group and individualized instruction tw'^ras place at f:he 
storefront alao* The selection of children is based on referrsls 
made to tha program by guidance counselors, teachers, parents, 
principals, assistant principals, aocit^l workers, and tha court. 
The pupila were attending seven schools in District S. 

The staff consisted of one program coordinator, one parent 
program assistant, two educational assistants, one clerk, one 
regular licensed teacher, and thirteen tutors. The educational 
aasidtants and the tutors were under the direct supervision of 
the regular teacher. The tutors, who were mostly college-students, 
had to go through a lengthy processing when they were hired that 
caused delays of t«io to three waeks. The parent program assistant 
suggested that tutors could be interviewed ta determine their 
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eligibility for zhm program in August ao that tha full staff wauld 
ba raady to start work in Saptaabar. 

Each pupil waa tasted in reading and mathamatica whan ha entered 
the program with the Metropoliten Achievement Test [MAT] Form F, 
and at the end of the program wi^hTthe MAT Form G. An evaluation 
of pupil weekneseee and strangths was made on the basis of 
MAT and other test reaults, conaultation with tha child's teacher 
at school, conversationa with the child and his parent, and ataff 
meetingti. The major emphasis of the program appeared to be the 
improvement of basic reeding akilla, including camprahenaion and 
vocabulary. Audio visual aids were utilized to provide initial 
motivation and orientation to specific points, and to reinforce 
materials studied. The audio viaual aide included audio-film 
strips with teacher's manuals, recording disks, write-on film 
strips, audio-repeat cassette recorders, headphonea, etc. A 
wide variety of curriculum materials were available and each 
tutor, in conrultation with his supervisors, dsvalopad an in- 
dividualized program for aach child. The program coordinator, 
parent program assistant, and the regular teacher conducted 
routine monitoring, observations, and conferences with the tutera 
and the educational aasistanta. The taacher assisted end 
evaluated each tutor and hie work with his tutse. On Fridoy, 
for four hours, the teacher met with the tutors for in-service 
training programs, individual counseling ssssions, lesson plsn 
preporation, and conferences with the tutee and his parenta. The 
supervising t:aacher also visited each tutor for about one-half 
hour when he was working with "the tutee in the home af the tut«e. 
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As a result: of being in 'the program the pupils ware expected 
to achieve statistically significant growth in their reading and 
mathematics scores as measured by scores on the MAT administered 
in October 9 1975 and June, 1976. 

The program was operational for the entire school year 
1975-1976. 

CHAPTER II: EVALUATION PKOCEDURES 

The evaluation obj actives were ; 

1. To determine whether as a result of attending 75% or snore of 
the Harlem Education Tutoring Program sessions, the reading 
grades of the participating students would show a statistically 
mignificant difference between the real post-test scores and 
the anticipated post-test scores. 

2. To determine whether as a result of attending 75% or more of 
the Harlem Education Tutoring Program sessions, the aathemetics 
grades of the participating students would show a statistically 
significant difference between the real post-teat scores and 
the anticipated post-test scores. 

3. It was anticipated that parents associated with the tutorial 
program would become more involved in school-community activities 
such that r.hey would increase their attendance at PTA meetings 

by 50%, as measured by a pre-post analysis of PTA meeting roators at. 
the beginning and toward the end of the school year. 

4. To determine the extent to which the program, as actually 
implemented would coincide with the program as described in 
the project proposal. 
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A Historical Regrassi.n Analysis was usad in ordar ta 
datermina if the raading and aathamatics gradaa on tha MAT tast 
shawed a statistically significant diffaranca batwaan tha raal 
Cor abtainad3 poat-tast scaras CJuna, 1976 taating] and tha 
anticipatad post-tast acaraa [baaad an Octaber, 1975 MAT 
pra-tast acoras]. Pra-tast and post-tast MAT raading and 
mathamaticB scoras wara availabla for 42 pupils in gradaa two 
through eight, but only 11 pupila had attended tha pragran for 
75% or more. Becauae only 11 pupila mat tha criteria of 75% 
attendance, aaveral additional compariaona wara made, including 
the use of all pupils with above and below 75% ettendance. 
CHAPTER III: FINDINGS 

A Historical Regresaian Analysis wss used to dataraino 
whether as a raault of attending 75% or aara of tha Har^l^aa Eduoati 
Tutoring Pragraa sessions, the reading and aathefflatica gradaa 
of the participating pupila would ahow a atatiatically aignificant 
difference between the real poat-taat scorea and tha anticipatad 
post<»test scores when a correlated t test was applied. Gradaa 
were combined becauae of low aampla aize in each grade. There 
was one pupil in grade twe, ten pupils in grade three, hLx 
pupils in grade four, four pupila in grade five, aix pupila in 
grade six, eight students in grade seven, and seven students 
in grade eight. The correlated t teat reaulta far reading 
achievement, comparing the mean predicted post-test grades with 
the mean actual post-test grades, are shown in Table 1 on page 9 
in the Appendix. The improvement in reading skills above and 
beyond tha expected improvement if the pupils had not been in the 



program mms Bignificont for those pupile who attended 75% of the 
pragraa aeselona, except for the pupils in grades two, three, and 
four, and for the total sample. For pupils who had 75% attendance, 
the grade equivalent [GE] gain in months above the predicted 
gain ranged from 3.83 to 7.27 months. The range in GE gain in 
months for the total sample was 2.76 to 6.92. 

The correlated t test rosulta for mathematics echievement 
are presented in Table 2 on page 9 in the Appendix. In contrast 
to reading improvement, the gains in mathematics beyond these 
expected if the pupils had not been in the program, were not 
ttignificent, except for the total sample in the second, third, 
end fourth ^^rad^ds. A significant loss in mathematics skills 
secured for the four pupils in gradea two, three and four who 
had 7SX attendance in the program. The unreliability of scores 
baaed on a sample af four pupils la very high and not much can 
be attributed to this atypical finding« The GE gain in manthar 
for those pupils with 75% attendance ranged from -2.35 ta 2.05. 
The range in gain scores for the total sample was -.09 to 1.89. 
The lack of significant findings for mathematics could ^flect 
the fact that the major orientation of the program was to improve 

reading achievement and much leas emphasis was given to math- 

— ^ - i 

emetics skills. 

Perent ettendance data at PTA meetings during October, 1975 
through May, 1976 ^cre available for only 11 parents. Attendance 
at PTA meetings data were available for 14 other parents, but 
they could not be used as their children had Joined the program 
late in the year. For the 11 parents with complete attendance data, 
the results are shown in Table 3 on page 10 in the Appendix. The 
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PTA attendance during the first Four wontha of the program 

[77% attendance] was somewhat poorer than the second Four months 

oF the program ^BAx attendance], but the improvement was Far 

From the predicted 50% gain. The comparison of PTA attendance 

between the First two months of the pregram [95% attendance] 

» 

and the laat two months of the pregram £82% attendance] in- 
dicates a reduction in the number of meetings attended. The 
present evaluator, however, does not believe that the attendance 
reaults indicate a lack of parent involvement in scheol-community 
activities. The parent attendance at the PTA meetings was high 
for the entire year, which augyeats strong parent involvement. 
Only if attendance at PTA meetings waa low ac the start of the 
school year could one compare end of school year attendance aa 
an indicator of parent involvement as the parent becomes more 
concerned with the program. 

The ataff indicated that they had enough materials and 
supplies for the pregrem. The center had a large variety o^ 
readers, workbooks, educational games, and audio vieual aquipoment. 
The entire staff appeared to be especially well qualifid and 
enthusiastic about their work. In general, the atmosphere in 
the homes waa conducive to learning, and the parents coopereted 
in every way that they ceuld. The physical facilities at the 
center and in the homes 'nmrm adequate and enhanced individualized 
i na truct i o n * 

There appears to be no doubt that the program serviced 
the ncsede of the target population, students who were retarded 
by two or more years below grade level in reading and/or 
mathematics. The program as implemented did coincide with the 
program as described in the proposal. 
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Recomwendations From Last Prior Study 

!• IZ was recofflmended that the tutorial program 8H::« ji.j *^jm 

expanded. This recommendation was implemented f*'\5:h ^he hiring 
of 13 tutors this yeor in contrast to 11 tutors last year. 

2. Evaluative survey forms should be developed for asseasing the 
impact of the progrr^m on tutees and perents. This 
recommendation has not been implemented. 

3. An on-site classroom facility with necessary equipement 

i 

should be set up for an alternate tutoring sitr^). This 
recommendation has been fully implemented. 

CHAPTER IV: SUMMARY OF MAJOR FINDINGS, CONCLUSIONS, AND 
RECOMMENDATIONS 

Summer y 

The statistical analysis of the mean MAT prt^dicted post- 
test versus the actual post-test scores indicated a significant 
improvement in reading ability for all grades , except the 
pupils ^iT1 grades two, three, and four with 75% attendance. 
The GE gain in reading achievement for pupils in grades 5-8 
with 75% attendance was 3.83 mantha, and tho gain far pupils in 
grades 3-8 was 7.S7 manths. For the total sample, the GE range 
in gain scerets was 2.76 months for pupils in grades 2-4, 4.13 
months for pupils in grades 5-6, 6.92 months for students in 
grades 7-8, and 6.42 months for pupils in grades 5-8. 

The only significant improvement in mathematics ability was 
far the total sample of pupils in grades 2-4, where the GE 
gain was 1.56 months* The pupils in grades 2-4 with 75% attendance 
had a significant loss in mathematics achievement with a GE 
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le^ of 8.35 months. There were no significant changes in 
mathematics ability for the remaining pupils in grades 5-8 and 
3-8 with 75% attendance, and for the tot;al sample in grades 5-6, 
7-8, and 5-8. 

Only a slight improvement wb« noted in parent attendance 
at PTA meetinga during the second half af the pregram. Parent 
attendance at PTA meetings was high, however, during the entire 
school year. 

The program waa in full operation during the schaol year 
and was affectively coordinated by the program director and the 
parent program aaeistant. Physical facilities and materials 
used in the program were adequate and as described in the proposal. 
Conclusions 

The tutorial program in the home of the tutee can be 
considered clearly successful en the basis of impressive gains 
made in reading achievement. It is thus recommended that the 
program be cantinuaa. 

RecG:;:mendat ions 

1. Hire tutars in August so Zhi^C tutorial work can start in 
September. 

2. Give more systematic attention to math impravement. One highly 
organized and structured approach to remedial math instructian 
that is recommended is described in the final evaluation 
report written by the present evaluator entitled '^Summer 
Mathematics Remediation For Incoming Pupils - 1975 High 
School Umbrella U 8," and had the B/E Function No. 09-61618Cb}. 
The key feature of the above program was the setting up 
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»nd oxccutiwn mf a eystiematic , individualized, simple and 
direct attack en the mathematics weaknesses of pupils es 
diagnosed from the MAT results. For each pupil, a record s 
was filled out indicating areas of weakness diagnosed from 
the MAT in additieni subtraction, multiplication, division, 
fractions, decimals, and percentages. Next to each area on 
the record sheet there was a reference to the Learning To 
Compute Workbook section and pages that had problems to hel 
the pupil improve his skill for a given MAT weakneso. 
Evaluate parent involvement in program through objective 
questionnaires and parent participation in tho program, and 
not through attendance at PTA meetings. 
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Table 1 



Comparison of Predicted Post-teat vereus Actual Post- 
test Mean Grade Equivalancy Reading Scores by Grade 
Level and Attendance in PrograM 









Pro- 


test 


Actual 
.. Poet-te-'i't 


Anticipated 
Post-test 


GE Gain 
in Mentha 






Group 


Grade 


N 


M 


SO 


H 


SO 


M 


SO 




t; 


P 






A 


1 875 


435 


2.600 


.082 


2.060 


.508 


5 40 






7SX 


5-8 


7 


3.459 


.950 


4.164 


1.185 


3.781 


1.006 


3.83 


3.721 


.05 


75% 


3-8 


11 


2.882 


1.117 


3.882 


JL.388 


3.155 


1.200 


7.27 


4.386 


.01 


Total 


2-4 


17 


2.059 


.457 


2.424 


.458 


2.148 


.474 


2. 76 


3.337 


.01 


Total 


5-6 


10 


4.220 


1.012 


4.915 


.880 


4.502 


1.065 


4.13 


2.320 


.05 


Total 


7-8 


15 


3.733 


.790 


4.633 


1.081 


3.941 


.863 


6.92 


4.163 


.01 


Total 


5-8 


25 


3.928 


.898 


4.700 


.990 


4.058 


.984 


6.42 


A. 177 


.01 



Table 2 

Coapariaon of Predicted Pqst-'teet vareua Actual Poat- 

teat Mean Grade Equivalency MatheAiatica Scoraa by Grade 

Level and Attendance in Program 



ActaaL Anticipated OE Gain 

Pre-teat Peat-teat Post-teat In Months 



Group 


Grade 


N 


M 


SO 


H 


3D 


M 




SO 




t 


P 


75X 


2-4 


4 


2.275 


.591 


2.275 


.591 


2. 510 




.668 


-2.35 


-5.890 


.05 


75X 


5-8 


7 


4.500 


.849 


5.029 


1.C30 


4.900 




.906 


1.29 


0.416 


n.a. 


75X 


3-8 


11 


3.691 


1.340 


4.236 


1.408 


4.031 


1 


.442 


2.05 


0.944 


n.s. 


Total 


2-4 


17 


2.060 


.542 


2.365 


.545 


2.207 




.616 


1.58 


2.142 


.05 


Total 


5-6 


10 


4.270 


.909 


4.680 


1.060 


4.502 




.999 


1.78 


1.305 


n.a. 


Total 


7-8 


15 


4.900 


1.370 


5.147 


1. 142- 


5.156 


1 


.142 


-0.09 


-0.032 


n.a. 


Total 


5-8 


25 


4.656 


1.231 


4.960 


1.142 


4.894 


1 


.128 


0.B6 


0.480 


n.a. 
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Table 3 

Comparison ©F PTA Attendance at Beginning and at End mf ProgPi 



□■tes of Attendance 

10/75 - 1/76 g/76 - S/7e>. 



No. PTA 

Meetings 

Attended 



34 C77XD 



37 CB4X] 



No. PTA 

Meetings 

Missed 



10 C33X] 



7 C1SX3 



10/75 - 11/75 



4/76 - 5/76 



Ne. PTA 

Meetings 

Attended 



81 C95XD 



18 CB2X3 



No. PTA 

Meetings 

Missed 



1 C5X3 



4 C20XD 
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